REPORT DOCUMENTATION PAGE 



Form Approved 
0MB No. 0704-0188 



aa?her nS /nd maintainina the V«^ " ""jT^'*'' <° '""'9^ ' ''°"' P^ response, including the time for reviewing Instructions, searching existing data sources, 

??.!™'i^9^"f„yi'^*/'"'"9 '^.f,^i''« "f«^^^^^ '2^ reviewing the collection of inforn.ation. Send comments regarding this burden estimate or any othe? aspect of this 

Wnhwav Suuf 2oV A Mnaton vHjjS/^n^^^^^^^^ burden, to Washington Headguarters Services. Directorate for information Operations and Reports, U 15 Jefferson 

Highway, suite 1204, Arlington, VA 22202-4302, and to the Office of Management and Budget, Paperwork Reduction Project (0704-0188), Washington. DC 20503. 

3. REPORT TYPE AND DATES COVERED 



Davis 



1. AGENCY USE ONLY (Leave blank) 



4. TITLE AND SUBTITLE 



2. REPORT DATE 

March 1991 



memorandum 



Control Algorithms for Chaotic Systems 



6. AUTHOR(S) 

Elizabeth Bradley 



7. PERFORMING ORGANIZATION NAME(S) AND ADDRESS(ES) 

Artificial Intelligence Laboratory 
545 Technology Square 
Cambridge, Massachusetts 02139 



9. SPONSORING /MONITORING AGENCY NAME(S) AND ADDRESS(ES) 
Office of Naval Research 
Information Systems 
Arlington, Virginia 22217 



5. FUNDING NUMBERS 

N00014-85-K-0124 
N00014-86-K-0180 



8. PERFORMING ORGANIZATION 
REPORT NUMBER 



AIM 1278 



11. SUPPLEMENTARY NOTES 

None 



10. SPONSORING /MONITORING 
AGENCY REPORT NUMBER 



AD^A^Coc^i^p- 



12a. DISTRIBUTION /AVAILABILITY STATEMENT 

Distribution of this document is unlimited 



13. ABSTRACT (Maximum 200 words) 



12b. DISTRIBUTION CODE 



This paper presents techniques that actively exploit chaotic behavior 
to accomplish otherwise-impossible control tasks. The state space is 
mapped by numerical integration at different system parameter values 
and trajectory segments from several of these maps are automatically 
combined into a path between the desired system states. A fine-grained 
search and high computational accuracy are required to locate appro- 
priate trajectory segments, piece them together and cause the system 
to follow this composite path. The sensitivity of a chaotic system's 
state-space topology to the parameters of its equations and of its tra- 
jectories to the initial conditions make this approach rewarding in spite 



(continued on back) 



14. SUBJECT TERMS (key words) 

chaos control 

nonlinear dynamics scientific computation 



17. SECURITY CLASSIFICATION 
OF REPORT 

UNCLASSIFIED 



NSN 7540-01-280-5500 



18. SECURITY CLASSIFICATION 
OF THIS PAGE 

UNCLASSIFIED 



19. SECURITY CLASSIFICATION 
OF ABSTRACT 

UNCLASSIFIED 



15. NUMBER OF PAGES 

20 



16. PRICE CODE 



20. LIMITATION OF ABSTRACT 
UNCLASSIFIED 



Standard Form 298 (Rev 2-89) 

Prescribed by ANSI Std Z39-t8 
298-102 



Block 13 continued: 

of its computational demands. Boundaries of basins of attraction can 
be breached, vastly altering both global and local convergence proper- 
ties. Strange attractor bridges cein be found that connect previously 
unreachable points. Examples of both axe shown. 



MASSACHUSETTS INSTITUTE OF TECHNOLOGY 
ARTIFICIAL INTELLIGENCE LABORATORY 



A.I. Memo No. 1278 March 1991 

Control Algorithms for Chaotic Systems 

Elizabeth Bradley 

Abstract 

This paper presents techniques that actively exploit chaotic behavior 
to accomplish otherwise-impossible control tasks. The state space is 
mapped by numerical integration at different system parameter values 
and trajectory segments from several of these maps are automatically 
combined into a path between the desired system states. A fine-grained 
search and high computational accuracy are required to locate appro- 
priate trajectory segments, piece them together and cause the system 
to follow this composite path. The sensitivity of a chaotic system's 
state-space topology to the parameters of its equations and of its tra- 
jectories to the initial conditions make this approach rewarding in spite 
of its computational demands. Boundaries of basins of attraction can 
be breached, vastly altering both global and local convergence proper- 
ties. Strange attractor bridges can be found that connect previously 
unreachable points. Examples of both are shown. 



Copyright © Massachusetts Institute of Technology, 1991 



This report describes research done at the Artificial IntelUgence Laboratory of the Massachusetts 
Institute of Technology. Support for the laboratory's artificial intelligence research is provided 
in part by the Advanced Research Projects Agency of the Department of Defense under Office 
of Naval Research contracts N00014-85-K-0124 and N00014-86-K-0180. 

This paper was presented in March 1991 at the First European Conference on Algebraic 
Computing in Control and will appear in Lecture Notes in Control and Information Sciences. 



Control Algorithms for Chaotic Systems 

Elizabeth Bradley 

Department of Electrical Engineering and Computer Science 

Massachusetts Institute of Technology 

March 27, 1991 

Abstract 

This paper presents techniques that actively exploit chaotic be- 
havior to accomplish otherwise-impossible control tasks. The 
state space is mapped by numerical integration at different sys- 
tem parameter values and trajectory segments from several of 
these maps are automatically combined into a path between the 
desired system states. A fine-grained search and high computa- 
tional accuracy are required to locate appropriate trajectory seg- 
ments, piece them together and cause the system to follow this 
composite path. The sensitivity of a chaotic system's state-space 
topology to the parameters of its equations and of its trajectories 
to the initial conditions make this approach rewarding in spite 
of its computational demands. Boundaries of basins of attraction 
can be breached, vastly altering both global and local convergence 
properties. Strange attractor bridges can be found that connect 
previously unreachable points. Examples of both are shown. 



1 Introduction 

This paper presents control techniques that can be appUed to chaotic systems. 
The unique attributes of chaos are exploited by these algorithms in order to 
perform control tasks that could not otherwise be accomplished. Programs 
utilizing extensive simulation and global reasoning about state-space features 
identify nonlinear trajectory segments that can be pieced together into a path 
between the specified states. The driving concept behind this approach to 
control of nonlinear and chaotic systems is to combine fast computers with 
deep knowledge of nonlinear dynamics to improve performance in systems 
whose performance is rich but whose analysis is mathematically and compu- 
tationally demanding. 

In a nonlinear system, the distance between neighboring state-space tra- 
jectories can grow exponentially with time, so small trajectory perturbations 
can have serious global repercussions. The Voyager missions used Jupiter as 
a slingshot for just this reason: near the point of closest approach, a small 
change in angle, via a short rocket burn, drastically changed the spacecraft's 
overall path in a fashion simply unobtainable in a linear system. Small errors 
in that course correction can, however, have equally dramatic effects. This 
leverage is the power of and, paradoxically, the difficulty with nonhnearity. 

The system's state space is explored for different parameter values. Since 
nonlinear systems are exquisitely sensitive to these parameters, a small range 
of parameter variation can give the control algorithm a large range of behav- 
iors to exploit. Taking advantage of this range and understanding these 
behaviors, the automatic path-finding algorithm selects a set of trajectory 
segments from the maps and combines them to form a path through the 
state space between the desired system states. The controller causes the 
system to follow this path by monitoring the system state and switching pa- 
rameter values when the segment junctions are reached. Striking results are 
achieved with this technique: a very small control action, delivered precisely 
at the right time and place, can accurately direct the system to a distant 
point on the state space. In one of the examples in this paper, a small con- 
trol action briefly pushes a system in a counterintuitive direction in order 
to reach a path that travels directly to the goal state. In another example, 
an equally small change is used to move a particular state from the basin of 
attraction of one fixed point to the basin of another. 

These techniques can be applied to any system — linear or nonlinear 
— but chaotic systems have several properties that make them particularly 
useful from a control standpoint. Trajectories in such systems cover a subset 
of the state space densely, visiting arbitrarily small neighborhoods of every 
point in that subset. This denseness has obvious implications for reachability: 



chaotic attractors can be used as bridges between otherwise-unconnected 
points. Furthermore, such attractors contain an infinite number of unstable 
periodic orbits that can be located and stabilized. 

The rest of this paper is organized as follows. Section 2 briefly reviews 
pertinent aspects of nonlinear dynamics theory. Section 3 outlines the con- 
trol algorithms that are used here to find and follow paths through state 
space. Section 4 illustrates the algorithm with several numerical examples 
and section 5 summarizes the work, its implications and its connections to 
previous research. 



2 Theory 

The equations for an n- dimensional nonlinear system can be written 

dx 

— = F(x,h,...,kp,t) (1) 

where x is an n- vector whose elements are the system's state variables and 
F is a nonlinear function of the state x and the parameters fc,-. Necessary 
conditions for chaos are, in addition to the nonlinearity of F, that n > 3 
and F{x, fci, . . . , kp,t) be non-integrable[9]. The state-space trajectories of a 
dissipative chaotic system^ separate exponentially over time and yet remain 
on a bounded fractal subset of the state space, called a chaotic or strange 
attractor[15], within which are embedded an infinite number of unstable peri- 
odic orbits. The distance between nearby trajectories grows as 0(e'*'*), where 
A is the largest positive Lyapunov exponent [6] of the system. On a sur- 
face of section through the attractor, the unstable periodic orbits appear as 
fixed points at the intersections of the stable and unstable manifolds of the 
system (1) above. 

The direction and magnitude of the vector field described by the system 
(1) depend strongly on the equations' parameters. Locally, this sensitivity 
can be defined as 

V,,{x, h,...,kp,t) = dn^^^u-^-^h.i) (2) 

Changes in parameter values (Afcj) also affect the large-scale features of 
the state-space plot, causing fixed points to split and give birth to other 



^Hamiltonian or non-dissipative systems do not have attractors, as their equations 
preserve state-spa<;e volumes. 



fixed points, limit cycles or chaotic attractors. These topological changes 
are known as bifurcations. Between bifurcations, the Afcj can also cause 
dramatic changes in the position, shape and size of existing attractors. 

Both small- and large-scale changes can be exploited by control algorithms 
if the responsible parameters are accessible. For example, T4, can be used to 
identify regions of state and parameter space where small Afcj have locally 
large effects. Changes in attractor size or position can make a target state 
reachable from different areas of state space. Slow, roundabout paths and 
fast, direct paths between two points are often separated only by a small 
parameter difference. 

If a stable fixed point can be found near the target state for some parame- 
ter value, the control problem is more or less solved, provided that the initial 
state is in its basin of attraction. However, while the stable fixed points of 
a chaotic system do move about the state space as the parameters are var- 
ied, they might only wander over a small region before bifurcating into more 
complex attractors. In general, it is unlikely that any choice of parameter 
value would place a fixed point near the target state, unless the path of the 
fixed point were fortuitous. Moreover, convergence to such points is often 
slow. 

If no suitable fixed points exist, stabiUzation of the system state at a 
particular point is, in the classic sense, impossible. An alternative control 
objective is a steady-state orbit that returns to the target point every m 
cycles. The unstable periodic orbits embedded within a chaotic attractor 
can be located using the method of Gunaratne et ai[8]. Points on a section 
that return to their own small neighborhoods after m piercings are assumed 
to be very close to m-cycles; averages of tight bunches of such points are 
taken to be good approximations to unstable fixed points. 

These unstable periodic orbits can be stabilized using the control scheme 
developed by Ott et ai[13], wherein the system's dependence upon the pa- 
rameter is linearized about the fixed point on the n — 1-dimensional surface 
of section. This works where the linearization is a good approximation: in 
the n — 1-dimensional "control parallelogram" around the point, whose size 
is determined by the control parameter's range, its effects on the orbit and 
the orbit's unperturbed stability properties. A small change in k causes a 
k = ko periodic orbit to return, after m cycles, not to its original coordinates 
Vo, but to some nearby point V. The vector gk measures this effect: 



The stability properties are determined by integrating the variations 

dt ^ dxk 

around the orbit, p is the j*^ component of the system equations (1) and 
the Sik are variations around Vq. The unstable eigenvector e„ and eigenvalue 
\u of this matrix, together with the admissible variation of the parameter k* 
around ko and the vector gk, determine Pc,,, the size of the control parallelo- 
gram, according to 

P,, ^ k*\{l - XZ')gk • e,\ (4) 

Details about the derivation of these formulae are given in [13]. 

Since the control parallelogram surrounds a point that is embedded within 
a chaotic attractor, all trajectories will eventually enter the controller's do- 
main, be driven to the orbit, and, in the absence of noise, remain there 
indefinitely. The denseness of these orbits makes this technique very prac- 
tical if a chaotic attractor overlapping the target state exists; nevertheless, 
target acquisition is a problem. The delay before any particular trajectory 
wanders into the parallelogram is unpredictable, although it does depend 
stochastically on the ratio of the areas of the parallelogram and of the entire 
attractor. 



3 The Control Algorithm 

The following algorithm can be used to find a path between two state-space 
points A and B to within a tolerance T. The system is stabilized either 
at the target state or upon a nearby periodic orbit. Some restrictions on 
B do apply; these are discussed at the end of the section. This algorithm 
applies to linear, nonlinear and chaotic systems, but only with the latter 
can it exploit the dense unstable periodic orbits that are embedded within 
chaotic attractors. For expositional clarity, this presentation assumes that 
the system has a single parameter k; more parameters would simply increase 
the size of the search space and the number of indices needed to keep track 
of it. 

1 . Map the state space for different parameter values: 

• Pick an initial range (AA:) and interval [kiow^khigh] for k. 

• Construct state-space portraits at each kiow + nAk for (kiow + 
nAk) G [kiowikhigh], using A as one of the initial conditions. 



• Construct portraits with a smaller AA: in ranges where successive 
plots exhibit large differences (e.g., large y^;, stable fixed points 
near B, bifurcations or changes in areas of chaotic zones.) 

2. Establish the goal state: 

• Examine the collection of state-space maps and locate a stable 
fixed point that lies within T of B. 

• Failing that, identify parameter values that create chaotic attrac- 
tors overlapping B. Choose a surface of section S through B. 
Locate an unstable periodic orbit within T of B. Determine the 
size Pco of the parallelogram of control around the point where 
that orbit pierces S. 

3. Choose an initial grid size e and find the best (e.g., fastest, shortest 
euclidean distance) path between the grid squares containing A and 
B. This segment can be a portion of any trajectory on any of the state- 
space maps constructed in step 1. It is designated S°, starts at Sfj 
and ends at S'°,-„„; with k = ko. 



mtt 



4. Reduce e and find the best path between the grid squares containing B 
and S'fi^^i. Iterate on successively smaller scales until e < Pco- Record 
the ki value and the starting and ending states Sl^a and 5'y,„„; of each 
segment. 

5. Similarly, find the best path between So and A. The final e depends not 
on Pco but on the largest positive Lyapunov exponent of the attractor 
of which S° is a segment. 

The system state can be caused to evolve along a trajectory consisting 
of a series of path segments {5°, . . . , 5'} via the following set of control 
actions. Because of the recursive, longest-first nature of the path-finding 
algorithm, the segments are not followed in the order in which they are 
found, so the hst must first be sorted into the proper order {S"°, . . . ,5"''}. 
Beginning at A, the parameter is set to kg to initiate the first segment 5"° and 
the state is monitored until x = Sfi^^i- The parameter is then changed to k[, 
rerouting the system onto S'^. Clearly, it is vital that parameter switches take 
place much faster than the system's time scales. This procedure is repeated 
through all segments in the path. After the final switch, k is set to the value, 
determined in step 2, that creates the desired fixed point or unstable periodic 
orbit; in the case of the latter, the linearized control scheme of [13] is then 
activated. 



This algorithm finds globally good paths that have locally bad segments 
(e.g., driving east to an airport to catch a westward flight) — the sort of path 
that purely-local control schemes miss. Even paths between regions of state 
space that are apparently not connected can be found; the control parameters 
add dimensions to the space that can open conduits between those regions. 
The examples presented in the next section illustrate both of these cases. 

This particular version of the path-finding algorithm, simphfied for pre- 
sentation, does not apply to nonautonomous systems, problems where the 
final state is unspecified, or problems that require a specific path to be fol- 
lowed. However, adapting the algorithm to fit these cases requires only simple 
modifications. Time dependence simply adds a dimension to the problem. 
Where the state can acceptably settle anywhere in a given range, control 
problems could be solved with a broadened fixed-point search in step 2. 
Matching a specified path would require a different criterion for path choice 
in step 3 — not the fastest or most direct segment, but the best match to a 
specified path. 

Several caveats accompany this method: 

• B may not fall near an unstable periodic orbit or a fixed point for 
any value of fc, in which case the algorithm will fail. The non-zero 
fractal dimension of a chaotic attractor and the denseness with which 
trajectories cover it make the former less likely. 

• This method applies to systems of any dimension, but the periodic 
orbit stabilization method of [13] requires that there be at least as 
many accessible parameters as there are unstable eigenvalues of the 
orbit. 

• If state variables are not directly accessible, information about the sys- 
tem state must be synthesized from outputs and other accessible sig- 
nals. Systems in which this is not possible cannot be controlled using 
this approach. 

• Slight timing or parameter value errors (e.g., quantization error) can 
be magnified exponentially, particularly if they occur at the beginning 
of a long segment or in an area of large g^ ' . The property elucidated 
in the Beta Shadowing Lemma^ keeps these errors from being truly 
disastrous, but they still place a fundamental upper bound on realizable 
path length. 



^Because "with high probability, the sample paths of the problem with external noise 
follow some orbit of the deterministic system closely" [7] and the deterministic orbit lives 
on a bounded attractor. 



Constructing and examining state-space portraits is time-consuming. This 
motivates the attempt in step 1 of the algorithm to restrict attention to the 
useful ones — new maps only being considered useful if their portraits differ 
from the existing ones, regardless of the A;-interval between plots. The region 
of state-space considered is also restricted: it must be somewhat larger than 
the bounding box of A and B in order to allow for locally counterintuitive 
moves. The size of this region is determined heuristically and can be varied 
if the algorithm fails to find a path on its first pass. There are many obvious 
points in this procedure where computation can be traded for accuracy: a 
smaller Afc and a larger range [kiow,khigh,], location and study of different 
unstable periodic points to find the one that is closest to the target state 
or whose control parallelogram is largest, variational analysis around each 
segment to check whether, for example, the k = 49.9 path is better than the 
k = 50 path, etc. 

Preliminary versions of these path-finding and control algorithms have 
been implemented and tested. The programs are written in the Lisp dialect 
Scheme[14] and run on an HP series-300 workstation. State-space portraits 
are computed from a given set of system equations using a fourth-order 
Runge-Kutta adaptive time-step integrator. Trajectories are indexed on a 
state-space grid and represented as lists of the grid squares that they en- 
ter. The grid size e is manipulated as part of the search in step 3 of the 
path-finding algorithm. 

The next section of this paper illustrates these techniques with several 
numerical examples. 



4 An Example 

The Lorenz equations[ll] are: 



F(x, a, r, b) = 



dx 
dt 

dy 
dt 

dz 
dt 



a{y- 


-x) 




rx - 


y- 


xz 


xy - 


■bz 





(5) 



These well-known equations approximately describe convection in a sheet of 
fluid heated from below. The state variable x is proportional to convection 
intensity; y and z quantify temperature variations, a and r are physical 
parameters of the fluid — the Prandtl and Rayleigh numbers — and b is an 
aspect ratio. Numerical integration of these equations from an initial state 
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Figure 1: Lorenz Attractor for a = 16, r = 45 and b = 4 

xo = (xo, yoi zq) yields a time-parametrized trajectory x{t) in state space. 
F is dissipative and nonlinear. It is also non-integrable for some parameter 
values; for these values, its trajectories converge to a chaotic attractor. A 
particular case of this, shown in figure 1, occurs for a = 16, r = 45 and 
6 = 4. As this figure is an a; — ^ projection of a three-dimensional object, the 
apparent trajectory crossings do not represent uniqueness violations. The 
parameter values and the initial state are shown at the bottom of the figure. 
The values in the upper right and lower left corners are normalized axis 
coordinates. An x — z section^ of the same attractor at y = —15 is shown in 
figure 2. More details about the structure and properties of Lorenz attractors 
may be found in [19]. 

Consider the task of navigating between the two points marked by crosses 
in figure 3, starting at the rightmost (A) and ending at the leftmost (B.) 
On the axes of the figure, the coordinates (x, y, z) of these points are (8, 
29, 64) and (-24.5, -20, 68). r is used as the control parameter and a and h 
are fixed. We make no assertions about whether changing this parameter is 
either physical or practical; this is purely a mathematical example^. 

As set out in step 1 of the algorithm in section 3, the state space is 
mapped with an initial r-step of five and an r-range of [20,60]. Portraits are 



^Points appear on this section where the trajectory pierces the j/ = — 15 plane with a 

positive velocity. 

"^Lorenz himself explored the parameter space outside the range (r « 1) within which 

the equations are considered to be an accurate physical model. 
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Figure 2: x-z Section of Lorenz Attractor for a = 16, r = 45 and b = 4 
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Figure 3: Origin and Destination Points 
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Figure 4: Two Stable Fixed Points 

also constructed on a finer grain (Ar = 1) near, for example, the bifurcation 
at r = 24 that creates a chaotic attractor and in the range where that 
attractor expands to cover B. 

Proceeding to the first part of step 2, the maps are examined for stable 
fixed points of the system (5) at or near B. The Lorenz attractor collapses 
to a pair of stable fixed points at low r, as demonstrated by the r = 20 
trajectories in figures 4(a) and 4(b). Note that the two starting points are in 
different basins of attraction. Both of the fixed points — whose coordinates 
are (8.72, 8.72, 19.00) and (-8.72, -8.72, 19.00)^ — move as r is varied, but 
neither approaches B for any value of r. 

Since no appropriate fixed points exist, the second part of step 2 indicates 
that the maps should be examined for nearby chaotic attractors and unstable 
periodic orbits. Figure 5 shows a trajectory for r = 30, just above the 
bifurcation that changes the fixed points of figure 4 into a chaotic attractor. 
Neither A nor B happens to lie upon this particular attractor, so it cannot 
be used as a bridge between them or as a source of nearby unstable periodic 
orbits. As r is raised further, however, the attractor expands; one of its 
lobes overlaps B when r = 42 (figure 6). For r — 50, an unstable seven- 
cycle is found on the y = —20 x — z surface of section at V^ = (-24.673, 
68.207). This orbit is found by computing 3000 piercings of the y = —20 
plane, identifying, sorting into bunches and averaging those that return after 
m cycles, and then choosing the one closest to B. We assume, for the purposes 



^The symmetry is not coincidence; see [19] for details. 
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Figure 5: Lorenz Attractor fora = 16,r = 30 and b = 4 
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Figure 6: Lorenz Attractor for a = 16, r = 42 and b = 4 
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Figure 7: Lorenz Attractor for a = 16, r = 50 and b = 4 

of this problem, that errors smaller than 1% of the total signal amplitude 
y/x"^ + y"^ -\- z"^ are admissible, so V^ meets the specifications. The eigenvalues 
of the variational system integrated around the seven-cycle are A^ = 0.734 
and As = —502.077, with the associated eigenvectors e^ = 0.834x + 0.5521 
and i-a = 0.685;r + 0.7281. A 1/2% change in r causes the point V^ to return 
not to itself (-24.673, 68.207), but to 'P'" =(-23.929, 66.498), so 

dV'^ 1 -„ 

gr = ■^-|.=5o « -^{V - V) = 70.8x - 170.9i 
or Ar 

The allowed range of variation of r, for a 1% control tolerance, is ±0.0075. 
Using these values in equation (4), we obtain Pc^ = 0.096 to complete step 
2. 

Using an initial choice of e = 20, the collection of portraits is examined, 
as described in step 3, for paths between the grid squares containing A and 
B. The r = 50 portrait of figure 7(a) contains one such segment, hereafter 
designated 5°. An edited version of this portrait, plotted on a smaller region 
around the two points and showing only the useful part of the trajectory, 
is shown in figure 7(b). 5° pierces the y = —20 plane at (-24.51, -19.99, 
68.05), which is actually within the control parallelogram, so no additional 
path segments need be found to connect S^ and B. 

To find trajectory segments that connect point A to the other end of 5°, 
step 4 is iterated in the region outlined by the square in figure 7(b). The 
nature of the projection makes the distances deceptive; A is actually quite 
far above the nearest threads of the r = 50 attractor. The segment S^, found 



13 



(-24.5, -20, 68) 
B 




(8.82, -4.37, 57.44) 



r3 = 8 



SO 
rO = 50 



Figure 8: Schematized Segmented Path 

on the r = 40 map with e = 1, spans most of the distance from A to 5°. One 
more iteration is required on a yet-finer scale (e = 0.0001) to find the two very 
short segments S^ and 5^, at r = 10 and r = 8, needed to connect S^ to A 
and to 5°. Since 5° actually enters the control parallelogram around B, this 
process of connecting to it amounts to a solution to the "target acquisition 
problem" of [13]. 

A schematized version of the overall path {S'^,S^, S^, 5°} is shown in fig- 
ure 8. It is composed of the four segments discussed in the previous two 
paragraphs. The two longer segments are segments of chaotic attractors; 
the two shorter ones, enlarged so as to be visible, are sections of transient 
trajectories ultimately destined for one of the system's fixed points. The for- 
mer are examples of a "strange attractor bridge" , connecting two otherwise- 
unconnected points. The values for the r,- and the S^f^^^i are shown next to 
the segments and the transition points where they meet. The actual numer- 
ical integration of the path from A to B along {S^ , S^ , S'^ , S°} is shown in 
figure 9. On this scale, the smaller connecting segments are invisible. Note 
that S^ actually moves the system state directly away from B. This locally 
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Figure 9: Numerical Integration of Segmented Path 

counterintuitive move is made in order to reach a globally good path. 

The control program causes the system to follow this segmented path 
by monitoring the system state and switching the parameter accordingly. 
The transition that initiates 5° is the most critical of the three, as nonlin- 
ear expansion along its great length can severely magnify any error; this is 
where the four decimal place accuracy becomes important. The path length 
between A and B is 130.1 normalized distance units, requiring 0.3567 nor- 
malized time units to traverse. The contrast to the case without active target 
acquisition (see [13]) is striking: if a trajectory is started at A and simply 
allowed to evolve with r = 50, it enters the control parallelogram around B 
after traveling 25223 normalized distance units around the attractor in 104 
normalized time units. See figure 10. 

If B were near one of the system's low-r fixed points, the first part of 
step 2 would succeed. Though a single segment might then converge to the 
desired state, use of a segmented path can alter macroscopic quantities like 
convergence speed and reachability. For example, a trajectory starting from 
the point (22.4, 30.5, 60) at the value r = 25 would normally converge to 
the left hand fixed point (-9.80, -9.80, 24.00) along the tightly-wound spiral 
at the bottom left of figure 1 1 . The right-hand path in the figure was found 
by a single pass of the first two steps of the algorithm with e = 5. This path 
contains two segments: an r = 60 trajectory that travels most of the way 
from (22.4, 30.5, 60) to the other fixed point, which lies at (10.25, 10.31, 
26.77), and a short section of the r = 25 spiral that surrounds the second 
fixed point. Not only has this manipulation allowed the trajectory to jump 
the basin boundary and converge to the opposite fixed point, but it has also 
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16,76 







Figure 10: Without Target Acquisition 




Figure 11: Segmented Path to a Fixed Point 



16 



bypassed much of the slowly-converging spiral around that point. 



5 Conclusion 

The state-space features of chaotic systems are strongly affected by param- 
eter values. Moreover, the trajectories that make up those features separate 
exponentially over time. Small changes in parameters or state can thus have 
large and rapid effects; this leverage is a powerful tool for control algorithms. 
In this paper, we have indicated how fast and accurate computation can be 
used to synthesize paths through a chaotic system's state space that exploit 
this leverage to accomplish otherwise-unattainable control tasks. Nonlinear 
dynamics provides the mathematical tools used to choose values, tolerances, 
heuristics and hmits for the algorithms that select and piece together trajec- 
tory segments to create these paths. The Lorenz system is only one of the 
many systems to which these techniques can be apphed. Other examples, 
with perhaps more practical benefits, are phase- locked loops [4], robot manip- 
ulators and spacecraft controllers [18], and single and double pendulums [5]. 
This brief list is far from complete. 

The algorithm is not yet fully automated; for example, the determina- 
tion of when an attractor "covers" a point was made by eye. Algorithms 
that produce qualitative descriptions of state space, Uke the Bifurcation 
Interpreter[l], KAM[20] or PLR[16] will be involved in the ultimate mecha- 
nization of this. Mathematical models are currently used to construct state- 
space portraits; errors in these models can cause spectacularly bad control 
decisions. Experimentally exploring and mapping the state space of a physi- 
cal system [10] would probably be much faster and would also obviate mod- 
eling error. Although these techniques have, to date, only been applied to 
simulated devices, the ultimate aim of this project is to control actual phys- 
ical systems. Instrumented versions of several chaotic systems — a double 
pendulum, a driven single pendulum, and several phase-locked loops — have 
been built. The I/O channel that transmits the state information and con- 
trol parameter values between controller and system is under construction. 
These tools will be used to obtain experimental verification of the results 
presented in this paper. 

In the most general terms, the implications of this work are that: 



• 



A broader view and understanding of chaotic state- space features and 
the effects of parameters upon them is a powerful tool, but its applica- 
tion requires great computational effort. 
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• Understood and controlled, chaotic behavior can be profitably used to 
improve a system's design and performance. 

This approach can be thought of as a new flavor of adaptive control — 
one that takes a global viewpoint and eschews almost all Unearization^. It 
extends the active use of chaos in control, which presently consists of (1) 
using knowledge of chaotic zones' boundaries to site an operating point in 
the middle of the widest part of a system's largest stable zone to maximize 
noise immunity[17] and (2) the recent work on unstable periodic orbits [13] 
discussed at various points in this paper. The main difference between this 
work and [13] hes in the breadth of the aims: we wish, rather than to stabilize 
a system on a particular type of orbit, to navigate dynamically through all of 
state space with minimal restrictions. This project also extends the ongoing 
program of research in our group [3] with the overall goal of investigating the 
use of combined numerical and symbohc methods in scientific and engineering 
computing. 

The complexity of the tasks that are executed by this control program 
and the accuracy with which it must perform make computation speed a vital 
issue. The program must compute, store, search through and recognize fea- 
tures in a large number of intricate state-space portraits whose topologies are 
extremely sensitive to parameter variations. At the same time, many com- 
putational approximations are out of bounds because the small errors that 
they introduce can be amplified exponentially. Physical constraints require 
that control actions take place about an order of magnitude faster than the 
actions of the system itself, which further exacerbates the demands on the 
program's speed. All of this work is worth it: allowing a system to operate 
in its chaotic regimes opens up new possibilities for better designs. Faster 
computers [2] or special-purpose hardware might be part of the ultimate so- 
lution, together with the understanding and algorithms gained in the course 
of this research, to attaining novel and effective control of useful systems via 
knowledge of nonhnear theory and intensive computation. 



^Some authors in the adaptive control literature have hinted in the direction of control- 
hng chaos, but they fall short of active pursuit of the idea, admitting only that "chaotic 
pa:rameter estimates are not necessarily a bad thing to have" [12]. 
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